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Abstract 

This study focused on educational research papers published from 2005-2009 in journals listed in SSCI and the 
ULAKBIM database in Turkey. Study types, research methods, investigated specific topics, used data collection 
tools, employed data analysis methods, and utilized types of samples and sampling methods were analyzed. A 
total of 2115 papers published in 19 Turkish educational research journals (5 of them listed in SSCI and 14 listed 
in ULAKBIM) were subjected to content analysis by using the ‘Educational Research Papers Classification Form 
(ERPCF)’. The results showed that most of the studies belonged to the disciplines of instructional technology, 
science education, guidance and counselling, and mathematics education. Regarding the research methods, it 
was found out that quantitative studies predominated within educational research. Turkish educational researc¬ 
hers commonly used quantitative data collection tools and descriptive analysis methods. The most frequently 
studied samples participants were undergraduate students and teachers. The comparative results for the pa¬ 
pers published in the journals listed in SSCI and ULAKBIM showed that there was no significant difference in 
terms of either the research methods employed or the data analysis methods used between the two indices. 
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There has been a proliferation of educational re¬ 
search papers published recently. Educational re¬ 
search plays a major role in influencing and inform¬ 
ing educational practice. Some of these published 
studies have been the basis of educational reform, 
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while others were conducted following reforms. In 
general, educational researchers utilize previous re¬ 
search to develop their conceptual and theoretical 
frameworks, and to provide qualitative (e.g., con¬ 
tent analyses) and quantitative (e.g., meta-analyses) 
reviews of the literature, from which key find¬ 
ings are summarized (Karadag, 2009). Mortimore 
(2000) suggested four tasks to undertake in educa¬ 
tional research. These are to observe and record sys¬ 
tematically, to analyze and draw out implications, 
to publish findings, and crucially, to attempt to 
improve educational processes and outcomes. Cri¬ 
tiquing the quality of published research also helps 
other researchers and readers to make use of educa¬ 
tional findings, and it tends to improve the quality 
of papers which are published (Karadag, 2009). 

Many research studies are done in areas indepen¬ 
dent from each other. The recent increase in the 
number of research papers has led to new problems 
to overcome. For instance, when the number of pa- 
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pers increases, it becomes difficult for researchers, 
particularly newcomers to a field, to access all the 
papers in a particular area of study. Even if they can 
access the papers, they may experience difficulties 
when attempting to read and comprehend so many 
of them. Falkingham and Reeves (1998) suggested 
using content analysis to summarize large amounts 
of published studies in particular subject fields, in 
order to help readers digest the material more eas¬ 
ily. Several content analyses (Greene, 1998; Jenkins, 
1997; Liao, 2007) were subsequently performed to 
highlight the trends in particular disciplines. For 
instance, Jenkins analyzed 4918 papers in school 
psychology, published in five different journals 
between 1964-1995 to illuminate potential, future 
research topics in that field. 

Turkish researchers have also started to perform 
content analyses and meta-analysis studies (Arik 
8c Turkmen, 2009; (Jalik, Unal, Co§tu, 8c Karata§, 
2008; Giilbahar & Alper, 2009; Sozbilir, Kutu, 8c 
Ya§ar, (in press); §im§ek et al., 2008, 2009; Yildiz, 
2004) to summarize the greatly increased amount 
of educational research papers published in the last 
ten years. Arik and Turkmen (2009) investigated 
papers published in educational journals in Turkey 
and also those listed in SSCI ( Social Science and 
Citation Index'). Their results show that major¬ 
ity of those papers involved Educational Technol¬ 
ogy, and that descriptive studies were common. 
Another content analysis study was performed 
by Yaltpn, Bilican, Kezer, and Yal^in (2009). This 
study focused on papers published in the Hacettepe 
University Journal of Education, which has recently 
been included in SSCI. Their results confirmed 
the previous study by demonstrating that quanti¬ 
tative studies were the most common type. Some 
content analyses were focused on particular sub¬ 
disciplines of educational sciences in Turkey. Kara- 
su (2009) specifically investigated single subject 
studies in Special Education and found that stud¬ 
ies which used parametric statistical techniques 
produced more applicable findings. Erdogmu§ 
and (^agiltay (2009) investigated 248 Master’s and 
doctoral dissertations in Educational Technology. 
They reached the conclusion that research studies 
in this area have been limited in scope, and have 
mostly been produced by only a few universities. In 
addition, they also found that these studies display 
several methodological weaknesses. Uzunboylu 
and Oz<;mar (2009) studied 1309 research papers 
published during 1990-2008 in the field of com¬ 
puter supported language instruction. Their re¬ 
sults indicate an apparent increase in publications, 
starting from 1997 and reaching a peak in 2005. In 
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a comparative study to compare the effectiveness 
of face-to-face instruction with internet-based 
distance education, §ahin (2005) investigated ex¬ 
perimental studies carried out from 1994-2004. 
Tsai and Wen (2005) conducted a content analysis 
of 802 papers published in International Journal of 
Science Education, Science Education, and Journal 
of Research in Science Teaching from 1998-2002. 
They focused on authors’ nationality, research 
designs, and titles. Following this study, Lee, Wu, 
and Tsai (2009) conducted a similar study on 869 
papers published from 2003-2007 in Science Edu¬ 
cation journals indexed in SSCI. Lee et al. (2009) 
described their findings and also compared these 
with the results of Tsai and Wen (2005). They 
found that there was an increase in the number of 
papers published in non-English speaking coun¬ 
tries, and also that most of the studies focused 
on learning. Sozbilir and Kutu (2008) conducted 
a similar review in Turkey, in which studies were 
subjected to a content analysis to identify issues 
and research trends in science education in Tur¬ 
key. They analyzed research methods used, topics 
that frequently appeared in titles, and data analysis 
strategies employed in 413 papers published in 28 
national journals, incekara (2009) investigated 56 
papers published in Journal of Marmara Geography 
from 1996-2008 and 24 papers in East Geography 
Journal from 1995-2008, in the field of Geography 
Education, incekara’s purpose was to identify the 
trends in Turkey and to compare these with inter¬ 
national studies. A similar study of Mathematics 
Education papers was performed by Uluta§ and 
Ubuz (2008). They investigated papers published 
in Eurasia Educational Research Journal, Hacettepe 
University Journal of Education, Elementary Educa¬ 
tion Online, and Education and Science. Another 
study in Mathematics Education was conducted by 
Kayhan and Koca (2004), on research papers pub¬ 
lished from 2000-2002. 

Content analysis studies which are supported by 
statistical findings help to effectively summarize the 
results of large numbers of research papers, which 
in turn facilitates reliable and valid generalizations 
in a research area (Saglam 8c Yuksel, 2007). A con¬ 
tent analysis of the educational research studies 
published in Turkish journals that are indexed by 
SSCI and the ULAKBIM database is still needed to 
fill a gap in this area in Turkey. Therefore, this study 
focused on educational research papers published 
from 2005-2009 in journals listed in SSCI and the 
ULAKBIM database in Turkey. Study types, re¬ 
search methods, specific topics investigated, data 
collection tools used, data analysis methods em- 
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ployed, and types of samples and sampling meth¬ 
ods used were analyzed. This study was particularly 
designed to answer following research questions. 

1. What are the trends in educational research pa¬ 
pers published in the Turkish educational jour¬ 
nals listed in the SSCI and ULAKBIM indexes 
from 2005-2009 in terms of types and methods 
of papers? How have the investigated param¬ 
eters changed, according to these indexes? 

2. Which topics are frequently studied in these 
research papers? 

3. What data collection tools are frequently used? 
How have the investigated parameters changed, 
according to these indexes? 

4. Which data analysis methods are frequently 
applied? How have the investigated parameters 
changed, according to these indexes? 

5. What are the types and level of samples, and 
sample sizes in these research papers? How have 
the investigated parameters changed, according 
to these indexes? 

6. How have the numbers of research questions/ 
hypotheses changed in these research papers ac¬ 
cording to these indexes? 

Method 

Research Design 

This is a content analysis study. Content analysis is 
commonly used in qualitative studies, and is de¬ 
scribed by Bauer (2003) as follows: 

While most classical content analyses cul¬ 
minate in numerical descriptions of some 
features of the text corpus, considerable 
thought is given to the ‘kinds’, ‘qualities’ and 
‘distinctions’ in the text before any quantifica¬ 
tion takes place. In this way, content analysis 
bridges statistical formalism and the quali¬ 
tative analysis of the materials. In the quan¬ 
tity/quality divide in social research, content 
analysis is a hybrid technique that can mediate 
in this unproductive dispute over virtues and 
methods (p.132). 

In this study, content analysis indicates the sys¬ 
tematic analysis of papers. This study provides a 
content analysis of the educational research papers 
published in Turkish journals listed in SSCI and 
the ULAKBIM database. This study will help to 
illuminate the trends and quality of recent educa¬ 
tional research studies in Turkey. 


Data Collection Tools 

Each paper selected for analysis has been subjected 
to a content analysis by using the ‘Educational Re¬ 
search Papers Classification Form (ERPCF)’. ERPCF 
is a modified version of the “Paper Classification 
Form (PCF),” which was developed by Sozbilir et al. 
(in press). Expert help has been sought to establish 
the validity and reliability of the ERPCF. 

The form is composed of eight components. These 
are descriptions of the papers, types of paper, dis¬ 
cipline to which the paper belongs, the research 
method employed (quantitative, qualitative, mixed, 
or review), data collection tools, sampling (sam¬ 
pling, sampling procedure, number of samples), 
data analysis methods (quantitative or qualitative), 
and a final section that includes additional informa¬ 
tion about the papers. 

Data Analysis 

Following content analysis, all of the data were 
recorded in a database. Recorded data were trans¬ 
ferred to SPSS 16.0 and the results were analysed. 
The results are presented in a descriptive manner as 
frequencies, percentage tables, and charts. 

Content Analysis Procedure 

During the content analysis process, two supervi¬ 
sors and five doctoral students worked together. In 
order to achieve a reliable classification of the pa¬ 
pers, initially the authors worked together. Sets of 
the selected papers were classified. Disagreements 
were discussed and resolved, and then the rest of 
the papers were classified by collaborative work be¬ 
tween the authors. Again, any disagreements were 
resolved with leadership by the two supervisors. 
The researchers followed the following steps: 

a) Re-design the data collection tool according to 
the educational research papers. 

b) Identify the journals to cover 

c) Identify and select the educational research pa¬ 
pers to include in the content analysis 

d) Conduct the content analysis according to the form 

e) Review the data from the analyzed content to 
control for transmission errors 

f) Organize the data collected and write the results 
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Conclusion and Discussion 

A total of 2115 papers published in 19 Turkish ed¬ 
ucational research journals (five of them listed in 
SSCI and 14 listed in ULAKBIM) were subjected 
to content analysis. The results showed that most 
of the studies belonged to the disciplines of instruc¬ 
tional technology, science education, guidance and 
counselling, and mathematics education. It was 
also evident that research studies on philosophy 
education, religion education, and health educa¬ 
tion were rarely represented by published works in 
these Turkish resource indices. The reason for the 
predominance of science and mathematics educa¬ 
tion research papers would be the fact that science 
and mathematics were both taught at all levels of 
schooling, and therefore the sampling was quite 
wide. Educational research papers on guidance 
and counselling were also common, as this disci¬ 
pline focuses broadly on both individual and social 
problems, and also on research methods. This field 
is well established and has interested educational 
researchers for a long time. 

Regarding the research methods, it was found out 
that quantitative studies predominated within edu¬ 
cational research in Turkey. When the quantitative 
studies were investigated in detail, it was evident 
that the majority employed non-experimental re¬ 
search designs, though some utilized descriptive, 
survey, and quasi-experimental research methods. 
This result indicated that Turkish educational re¬ 
searchers mainly focused on the identification of is¬ 
sues and problems within educational topics, rather 
than focusing on developing solutions for them. 

Turkish educational researchers commonly used 
quantitative data collection tools, such as question¬ 
naires, and attitude/personality/ability/aptitude 
tests. Alternative data collection tools, interviews, 
and observations were rarely used in the surveyed 
studies. Questionnaires and tests were preferred, as 
they are easy to use and widely available tools (Ba§, 
2005). This finding is also consistent with the find¬ 
ing that quantitative studies were the most com¬ 
monly used research method. 

Regarding data analysis methods used, our findings 
showed that Turkish educational researchers mainly 
rely on a single data analysis method. Among the 
types frequently used were descriptive analysis, and 
presentation methods such as charts, frequencies, 
and percentage tables, together with central tendency 
measures such as mean, median, mode, and standard 
deviation. Inferential statistical analysis methods such 
as t-test, and variance analysis were often used. The 
common tendency to rely on only a single data analy¬ 

"■458 


sis method indicates a deficiency and a lack of experi¬ 
ence in research methods in educational studies. 

The most frequently studied samples subjects were un¬ 
dergraduate students and teachers. This result showed 
that Turkish educational researchers mostly directed 
their research toward the tertiary (undergraduate) 
level, as this provides an easy to reach sample popula¬ 
tion and convenient sampling procedures. 

The comparative results for the papers published in 
the journals listed in SSCI and ULAKBIM showed 
that there was no difference in terms of either the 
research methods employed or the data analysis 
methods used between the two indices. Quanti¬ 
tative papers using descriptive data analysis pro¬ 
cedures were extensively published in each. This 
result reinforces the earlier observation that Turk¬ 
ish educational researchers frequently focus on the 
identification of issues and problems within educa¬ 
tional topics, rather than focusing on developing 
solutions for them. This indicates a large limitation 
in recent educational research within Turkey. 

This study focused on trends in recent Turkish 
educational research to help current and future re¬ 
searchers to identify the most widely studied areas 
and issues, and to note the gaps to be filled. Turkish 
educational researchers evidently have not acquired 
enough experience in the practice of different re¬ 
search methods, which might be useful for studying 
and overcoming many current educational research 
problems. In light of the above findings, the follow¬ 
ing suggestions are offered. 

1. This study could be extended by examining pa¬ 
pers published before 2005 in order to obtain a 
wider perspective. 

2. This study could be extended to include papers 
published in international research journals to 
make more valid comparisons. 

3. Turkish educational researchers need to go be¬ 
yond the trend to rely mainly on quantitative 
research methods. 

4. Educational research studies should be extended 
beyond science and mathematics education, and 
guidance and counselling to include areas such 
as Turkish education, environmental education, 
history and geography education, religion and 
ethics education. 

5. The sample populations of research studies 
should be further diversified and enlarged to 
produce more valid and reliable results, and also 
to assert a greater impact on policy developers. 
Rather than using a convenience sampling pro- 
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cedure (i.e., a small population or limited range 
of subjects), researchers need to employ random 
sampling using larger samples that cover wider 
regional areas and more diverse subject popu¬ 
lations. This will help to identify problems in a 
wider context. 

6. Together with descriptive studies, there is also a 
need for more comparative, evaluation, qualita¬ 
tive and mixed methods studies. Mixed methods 
studies are particularly important, as they com¬ 
bine quantitative and qualitative studies to pro¬ 
duce solutions for identified educational prob¬ 
lems and issues. 

7. In addition to enriching the research methods, 
data analysis and presentation methods need 
to be improved. Multiple data analysis methods 
need to be integrated into the studies. 

8. Finally, educational research must be focused on 
important research problems, rather than only 
on the identification of various, less critical is¬ 
sues in education. 
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Ekl. 

Ara§tirmada Taranan Dergiler ve Dergilerdeki Makale Sayilan (2005- 2009) 


Dergi Adi 

Derginin Turti 

2005 

2006 

2007 

2008 

2009 

Toplam 

EGiTiM ARA$TIRMALARI-EURASIAN 
JOURNAL OF EDUCATIONAL RESEARCH 

SSCI 

53 

72 

27 

41 

47 

240 

EGiTiM VE BiLIM-EDUCATION AND 

SCIENCE 

SSCI 

30 

39 

32 

35 

55 

192 

HACETTEPE UNiVERSiTESi EGiTiM 








FAKULTESI DERGlSl-HACETTEPE 

SSCI 

52 

45 

47 

55 

32 

231 

UNIVERSITY JOURNAL OF EDUCATION 








KURAM VE UYGULAMADA EGITIM 
BlLlMLERI DERGISi (KUYEB) 

SSCI 

19 

28 

42 

31 

29 

149 

TURKISH ONLINE JOURNAL OF 
EDUCATIONAL TECHNOLOGY (TOJET) 

SSCI 

48 

28 

27 

23 

27 

153 

AHIEVRAN UNIVERSlTESi EGiTIM 
FAKULTESI DERGlSI 

ULAKBiM 

4 

19 

14 

19 

44 

100 

ABANT1ZZET BAYSAL UNiVERSiTESi 

EGiTIM FAKULTESi DERGlSi 

ULAKBiM 

23 

0 

2 

0 

2 

27 

ANKARA UNiVERSiTESi EGiTiM 

BiLlMLERl FAKULTESi DERGiSi 

ULAKBiM 

17 

17 

26 

28 

0 

88 

(;UKUROVA UNiVERSiTESi EGiTiM 
FAKULTESi DERGiSi 

ULAKBiM 

0 

16 

10 

0 

21 

47 

ERZiNCAN UNiVERSiTESi EGiTiM 

FAKULTESi DERGiSi 

ULAKBiM 

7 

14 

14 

6 

0 

41 

GAZi UNiVERSiTESi TiCARET 

VE TURiZM EGiTiM FAKULTESi DERGiSi 

ULAKBiM 

3 

2 

1 

5 

0 

11 

1NONU UNiVERSiTESi EGiTiM 

FAKULTESi DERGiSi 

ULAKBiM 

12 

16 

12 

0 

15 

55 

KASTAMONU UNiVERSiTESi EGiTiM 

DERGiSi 

ULAKBiM 

38 

43 

51 

37 

53 

222 

MEHMET AKiF ERSOY UNiVERSiTESi 

EGiTiM FAKULTESi DERGiSi 

ULAKBiM 

1 

9 

0 

0 

5 

15 

MERSiN UNiVERSiTESi EGiTiM 

FAKULTESi DERGiSi 

ULAKBiM 

13 

12 

11 

13 

0 

49 

ONDOKUZMAYIS UNiVERSiTESi EGiTiM 
FAKULTESi DERGiSi 

ULAKBiM 

17 

15 

17 

8 

16 

73 

PAMUKKALE UNiVERSiTESi EGiTiM 
FAKULTESi DERGiSi 

ULAKBiM 

15 

21 

20 

28 

16 

100 

$AGDA$ EGiTiM DERGiSi 

ULAKBiM 

35 

40 

44 

42 

42 

203 

TURK EGiTiM BiLlMLERl DERGiSi 

ULAKBiM 

24 

22 

23 

22 

27 

118 

TOPLAM 


410 

458 

420 

393 

439 

2115 




460 

























